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Tr-.b paper describes a toolkit for buiid:ng ; 
multiagent autonomic systems The IBM 
. Ag^nl Building atxi Uam ; og Envhxmjnent 
(ABLE) provides a lightweight Java* agent 
irame-A'crk, a comprehensive JavaBeans lv 
library of intsjllgsnt software components, a 
■ set of development and test tools, and an 
agent platform. We describe a sales of 
agents ouvi using ABLE components and j|i 
present three case studies of applications 
iis&y the ABLE tadkit 7n* Autotune agent is 
a closed-loop controller agont thai supports 
hierarchical distributed control. Hie 
Subsumptian agent define apsdfte behaviors 
or strategies and can be plagqed into a 
multiagent subsumption infrastructbm The 
Autonomic architecture tenures 
sensors arrd effectors for interacting with the 
external onvftonment. layers of reflexive, 
reactive, and' adaptive $ub&umf>tton agonto, 
components that dynamically model the 
autonomic system itself and its envitonment, 
and components for emotions, planning, and 
executivedevei decision-making By using the 
ABL E component library to build agents 
running an the ABLE distributed agent 
platform, we discuss how we can 
incrementally add new behaviors and 
capabi I ities to intelligent; autonomic systems. ; 



It has been oyer 50 yea rs sinee Ala a Turing described; ; 
the pr o to lypi cut tes I lor mjcll i^en t mac h inesl; J x\l \ir - % 
ing'sview, a coinpuiereoulci be caltedyintelligeni if 
it could pass as a human white conversiagvia a cenn- 



puter terminal For researchers delving into the mys- 
teries of human and machine intelligence, the so- 
called Turing Test has been both an inspiration and 
a millstone around their necks since that: time;': 

The fieldof artifieia} intelligence (ai) started out with 
great hopes and fanfare, beginning with tlie Dart- 
mouth con Terence on At tn 1:956. The n ext decade 
saw an exploration of both symbolic and neural net- 
work approaches to knowledge representation, rea- 
soning, and machine learning. By 1970, all was go- 
.ingiso well that Ma rvin MLhsky declared in z Lifef 
■Magazine article, "In from Uiree tp dght years we; • 
will have a machine wiLh the general intelligence ci?; 
an average human being. I mean a machine that will 
be able to read Shakespeare, grease a car, play of- 
fice politics, tell a joke, have; a light At that point 
the machine will begin to educate itself with fantas- 
tic speed. In a tew months it will be at genius level 
and a few months after that its powers wilt be in- 
calculable/' Although his vision may still be valid, 
his : timing was off- by several decades. Even : though 
substantial progress has been made on the pieces of V 
intelligence— speech recognition, natural language 
understanding, knowledge representation, machine 
reasoning, machine learning, emotion, and speech 
generation — putting the pieces together to create 
human-level in telligence has proven to be difficult. 
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The arlificiai intelligence technology pendulum has 
swung from whole-hearted devotion to symbol -pro- 
cessing techniques, to reactionary forays into neu- 
ral networks and other.subsymbohc approaches, and 
on to biologically inspired genetic a igorithms and 
fuzzy reasoning. Today, most researchers admit that 
a combination of technical approaches must be used; 
to achieve human-level performance. In The Society 
of M ind , Mins ky - described a se t o f mechan isms that 
he called omental agents that operate in. parallel and 
thai, compete and cooperate to yield human intel- 
ligence. 1 );n liis subsumption architecture, Brooks de- 
scribes an architecture of behavioral layers thai pro- 
vides robust function and supports reactive behaviors 
inmechanicaf robots.- More recently, papers bySJor 
man and by Caulfield and Johnson have described 
^cfritectiires for consciousness or self-aware systems 
that rely on layered architectures with emotional 
components. 3,4 

Clearly, a monolithic software architecture using a 
single technology, will not bring us closer to our goal. 
hi our work, we are exploring an incremental ap- 
proach far developing intelligent autonoimc. sys- 
tems— systems that have .self-awareness and can rea- 
son about then internal components and state. 5 
Autbriomie systems must adapt to environmental 
changes and strive to improve their performance over 
lime. Hi ey must be robust and be able to routinely 
overcome internal component failures. Autonomic 
systems must interact and communicate with other 
systems in a heterogeneous computmg infrastructure. 
Our approach to buildingautoTtornic systems is based 
on comhinmg autonomous intelligent .agents- m a 
well-structured way. This approach mirrors the struc- 
ture of the human brain wherein there are clearly 
defined, funcnon-specilic processing centers con- 
nected by forward and backward communication 
channels and adaptive feedback loops. 

Tn this paper, we briefly describe an architecture that 
combines elements of these approaches and melds 
then] into a coherent, scalable arcLiitecture that we 
■believe will lead to robust deployed autonomic sys- 
tems. These systems rely on sensors to obtain input 
from the .world and effectors to take action and make 
changes to the world lire re are memory components 
providing :short-term,xlong-tennv : and associative 
memory functions. There are reitexive, reactive, and 
goal-oriented proactive components. There are com- 
ponents for. reasonings planning, and learning new 
behaviors from interactions with the world There 
is an emotional component that associates feelings 
svi tti in iernal st a tes an d in flue nces de eisi on -ma king 




and learning processes. This: .architecture re fleets 
much of what is known about how (>eople think and 
process information, including ;the role emotions play 
in our reasoning;^ 7 ■ 

This paper is organized as follows* First we describe 
the Agent Building and Learnmg Environment-: 
(ABIE), a software architecture and framework, com- 
ponent library, development toolings and agent pia t- 
forro for constructing autonomous intelligent agents 
and mul.ti agent systems. We then present two appli- 
cation case studies, a system administration appli- 
cation using multiple agents, and a diagnostic ap- 
plication. Nexl.wedevScribeseveralderivative.ABLB 
agents including the Autotune control a^ 
sjaiription agent, and an Autonomicia^ntthat is; arT 
ABLB-based architecture for increment ally building 
autonomic systems. We then discusst^he current sta r :: 
tus of ABLE and our plans for enhancing the toolkit 
and for implement .ing our autonortiic system archi- 
tecture; 

Agent building and learning environment 

The recent surge of interest in .software agents has 
prompted a corresponding increase in toolkits for 
constructing them. Although many projects use a 
"roll your own" approach in which each agent is 
uniquely hand-coded/ there are benefits to using a 
component-based approach. The Java** language/ 
has several characteristics that make it an idenLplat- 
loan for implementing agents: code portability re- 
sult in£ from its use of a standard virtual machine, 
support for object-oriented programming tech- 
niques, native support for multithreading, and intro- 
spection of object properties and methods; In. ad^ 
dition. the JavaBeans** component specification: 
enables the creation of reusable Java components 
with well-defined interfaces and behaviors, 

Quite a few agent toolkits and multiagent platforms 
are available for both educational and commercial 
use. The CIAgen t framework developed by one of 
the authors is a lightweight agent framework writ- 
ten int he Java language and intended for educational 
use,* lire Java Agent Template Lite (Jatlite) v de- 
veloped atvStanford University, is focused on com- 
munications-related issues of agent systems. The 
IBM AGLETS* mobile agent framework, now an open 
source project, provides a Java pla - form for crea \ ■ 
ing mobile agent applications, AgeiuButlder* * .from 
Reticular Systems (a pan of in telhOne Technolo- 
gies), is an integrated software development ■ toolkit 
lorconstrucd^^ (BDtyagents 
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x in Java. The ZEUS agent-building loolkit developed 
by British Telecommunications pic features a Java 
component -library, with a planning and : scheduling 
system, support foe multiple interaction protocols, 
and a set of tools for building agents. The PotuVda- 
lion for Intelligent Physical Agents (fipa), an inter- 
national standards body working for mteropcrabil- 

; jtyvbe twee n a g ents and agent.pla If o rrn s • h a s def i n ed 
spedJka lions for agents, agent management services; 

- and agent ■■communications::"- hinguages;--: Several- 
projects iinpletnentF.tPA compliant agenTplalforms.. 
The RPAQpco Source (PTPA:0S) J deve'ioped:by Nor- 
tel Networks, is an open source implementation of 
the FlPA agetU comniumcation language and agent 
platform. The Java Agent DBve fop men t(JADI.O: 
framework, developed at CSCLT S.p A (now Tcle- 
" com Italic Lab, or TILab) is another FtPA-compliant 
multi agent toolkit. For a more detailed oven-jew of 

. lhe.se agent environments, see Bigus and Bigus. 8 

. The Agent Building and Learning Environment 10 is 

:..a :■ Java -based toolkit for developing and deploying; 
hybrid intelligent agent applications. Hybrid ap- 
proaches syncrgisticallydraw cm tile strengths of each 
technology while conipeiisating for any weaknesses. : 

,.F6i example; rules: have the advantage of explicitly 
defined knowledge, but they can be brittle and in- 
llexible; Netiriil networks, in contrast, can adapt or 
lea rn from : inpu is, bu 1 1 he learned knowledge is of- : 
len difficult to make explicit. The value of combin- 
ing multiple techniques such as neural network leam- :: 

Y : .ingwithmlc^ 
by prior work. 1 ! 

The ABLE toolkit was designed to provide a fast, re- 
usable, and scalable architecture for the construc- 
tion of intelligent software components and agents. : 
A fundamental design philosophy of ABLE is that su c- 
ce.ssiul intelligent agents will require multiple rea- 
soning and learning techniques ABLE builds on the 
standard JavaBeans model by .defining a lightweight 
framework for agent behavior. ABLE has a compo- 
nent library of. data access, machine learning, ma- 
chine reasoning, and op tiixiizati on: algorithms pack- 
aged as JavaBeans, known as Able Beans, ab le 
provides a Java Swing-based GUI (graphical userhi- S: 
terfacej for creating and configu ring AJbieBean^.and 
for constructing and testing the agents built from 
them. ABLE also provides an agent platform for de- 
ploying agents; across a- distribu ted. computing sys^ ,:. 
lein. By building a apprehensive suite of intelligent 
JavaBeans and tooling lor easily combining and con- 
necting those beans. ABLE permits developers to ex- 
pkjre the applications of software agents and their 



behaviors in distributed mulliagent systems. The 
ABLE toolkit has been available for downloading 
from the IBM aiphaWorks^' site since May 2000,^ in 
the following sections, we describe the fundamental 
design and architectural attributes of ABLE. 

ABLE agent framework 

The ABLE agent framework is a lightweight software 
architecture that allows algorithms to be packaged 
as JavaBeans thai, can be deployed as standard Java: 
components or as autonomous agents. Figure I 
shows the set of Java j ntei faces and base classes com- 
prising the able framework. 

AblcBcans arc standard JavaBeans components used 
in the ABLE framework. The AbleDea n Java .inter- 
face defines a set of common artribu tes (name, com- 
ment, stale, etc.) and behavior (standard processing 
methods such as init( \ reset( V processC ), quit; )), 
allowing AbleBeans to be connected to form Able- 
Agent^ Able Beans are connected using three :un- 
damentaliydiflererrt methods: data ilow, events, and 
properties. 

Data-flow or buffer connections arc used to wue to- 
gether AbleBeans u^ing a data-fluw metaphor. Each 
AbleBean can have an inpu l buffer and an output 
butler that are implemented as Java Objects. A set 
of AbleBeans can be connected by buffer connec- 
tions forming a directed, acyclic graph. The set of 
AbleBeans is then processed in sequence starting at. 
the root of the tree. AbieBean takes the data 
from its input hu flcT, processes the data, and places . 
the data in its output buffer. This data-How mech- 
anism is extremely fast and is very useful for appli- 
cations such as neural networks: that have a natural 
data-flow processing paradigm. 

Event connections are used to. register an object as 
a listener on an AbleRean. AbleBeans support syn- 
chronous and asynchronous event processing w^in^ 
Able Events, which extend the Java EventObject 
class, bach Able Bean has an event queue on which 
it receives AbleEvent notifications or action requests 
to be processed. Each AbleEvent contains a Bool- 
ean flag that indicates whether the event should be 
handled synchronously on the caller's thread or asyn- 
chronously by placing it on the receiver's event queue 
a n d processing i t on a separate thread. Every 
AbleEvent can be used as either a data event with 
an associated evenlld (event identifier) and data ob- 
; jecLbr as air actmn event, with/an associated action 
s tring and data'- object. Data notification events hold 
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Figure 1 A3LE agent framework classes arkJ interfaces • 
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data and: allow AbJeBcans to: inform one another of 
complex state ehaiigcs. Action evci^t^ allow melhod- 
invocation with arguments and contain an action field 
that maps to a method name on the notified Able- . 
Bean. The Able-Event ■argument object is also passed 
to the method on the receiving Able Bean, Thus, any 
method can be called on a listening AbleBean . 
through this mechanism. Alth ough event processing 
adds some overhead, it is more flexible than hard- 
coded method ' calls between AbleBeans. : 

Frope rty connections are used to synchron Ize; two 
diJle rent properties -.residing in two diOereuL Able- 
Beans. Whenever the .first. property .value is changed 
via a setter, method, the second property on the sec- : 
ond bean is also changed via its setter method. 

AbleBeansuse Java serialization for persistence: All: 
data-flow, event, and property' connections are pre- 
served during the passivation and activation cycles. 
The ABLE run-tune environment has a well-defined 
set of .properties thn t enable serialized Able Agents 
lo be portable-; 



AbieEvents. Figure 2 snows the data holds in the 
AbleEvent class. "Hie AbleEveht class provides the 
means to send data between agents, to request ac- 
tions: to be performed by other agents, or to request 
transactions with results returned either t o the orig- 
inal requesting agent or to some other agent, Tf lis 
design allows the able event-processing infrastruc- 
ture to be used to implement a variety of agent in- 
teraction models. For example,^ dialog between i wo : 
agents can be supported by exchanges of AbieEvents 
where the action holds the request and the replyTo 
and rq)lyWith fields are used to correlate the re- 
sponses. Alternatively, an m termed! ary agent could 
sendarequ est lo one agen t an d b ave thai agen t send 
its response to a -third agent Or back to 
requester, Another scenario is to have an agent 
broadcast its response to an event to multiple agents 
by specifying a list of agents on the replyTo held. 
Oiya single agent can send out requests to multiple 
agents,-, and use the tra.nsacii.onlD lie Id to correlate 
the responses to the original requests. To summa- 
rize, the base able event-processing framework can 
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Figure 2: The AbleE vent olassv 
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be used to implement almost any agent communi- 
cation design pattern. 

AbleObject. '{'he AbleObject class provides a base 
implementation of the AbleBean interface, defin- 
ing the standard behavior for ail AbleBeans provided 
with Uie ABLE tooikib The AbleObject ciass extends 
Java UmeastRcGiotcObjcet and implements the 
AbleRyentT istener, . AbleRean, and AbleFventr 
Queue Pro c ensor remote inter [aces. It contains an 
instance of ^ 

lic-nal au Umomous timer facility as well ^ asynchro- 
nous event-processing functions for the bean. 'Die 
timer allows an Able bean to run autonomously by 
periodically going to sleep and then waking up to 
see whether anything needs processing. 

The AbicEveritListener interface defines two main 
processing;, methods; .processAbleEyentt ) and 
handleAbleEvenU .;. The first method takes an 
Abie. Event as an argument, examines its synr: 
chroj]ous/asyn(:hr<)nousBo 

it accordingly. Tlie second method unconditionally 
pre cesses ihe event m a syncbronoiis manner. De- 
fault behavior is presided to interpret the action 
string as a method name and to invoke a method 
with that name on the bean, passing the argument 
object as a parameter. 

Figure 3 shows the source code: for an example Abie- 
Bean; that; extends the AbleObject base class We mv 
port the cohubnuxbie package and provide a no^ 
argument constructor. Tlie major methods that must 
\K overridden mcludemitC ), which perfonnsone-tirne 
initialization; process* ), which isitlieinettjocl called to .; 
process .the input buffers; and prricessT linerEven t( }; : : i : 



which is the method invoked when the bean Ls con- 
figured to run as an autonomous agent. 

AbleAgent One of the -'major decisions when cre- 
ating an agent construction environment is the gran- 
ularity of the agents. Many j)rojecLs consider belief- 
desire -mtention (bdi) agents to Ix: ihe base line. In 
ABLE, we chose a model where the basic building 
blocks are functional software components but not 
complete agents. By making this choice, wo can cre- 
ate customized agents with; functionality and com- 
plexity suitable for their intended use. 

i he AhlclXtfauit Agent class provides a default im- 
plementation of the Able Agent -interface and defines, 
the standard behavior for all AbleAgents provided 

; with. the ablb framework;; The' AbleDefaultAgent 
class extends Java UnicastRemoteObject and 
AbleObject and implements both the AbleAgent and . 

oAbieBean Container remote interfaces. 

AbleAgents are AbleBeans That are also containers 
for otner AbleBeans. An AbleAgent has its own 
thread for processing events- asynchronously.- Able- 
Agents provide a useful abstraction for packaging a 
set of Able Boa as wired together -to perform a spe- 
cific fimclion Tnis function is then available to other 
AbleBe a n s or Able Agents through synchronous pro- 
cess! ) calls or through asynchronous event .proeess- 

AbleAgents extend the AbleObject base class and 
implement the AbleBeatiContaiiier and Abl'eUser? 
DeiinedFunctioriManager interfaces. Hie Able- 
BeanContamer allows an AbleAgent to contain other 
• ^lelJeatis arid eye 
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Figure 3 Sample AbleBean - : Java .'source- code; 



import cwrubm^bte, - ; 

p ibk * to $ampteAMe8<?an «-*\t*fi'b AbteObject Implements 5^ 
public StanipfeAbleBeanft thrown FtenK>teE*cepta { 

pubfe ^ofd ;r,n») thrown fomotcException f 
tfowd to tjt&afi w sUiaoi this Nan mV> * irs b k - do ONE TIME iwliatoli: n*. 
inmate as yncnrc i s f irw used} and del no fc /cnf :> t-eassms fc onav ^ 

pypKi proc<?»5?(} HrfAveRwi ^;U> *pft?n { 
7 perform s ,-nchrc k * pKsc&ssmg or csf'&fs thr<53d 



eriul design pattern allows extremely complex agents: 
lo be -built from subagents and is exploited in our 
component library implementation. The AbleUser-; 
DeftnedFunclionManager allows: external software 
10: be iniegrated wilh AbJeAgents as sensors and; 
eficctors. 

Note that alternate Able Agent . implemenla lions 
could be dcvelo|)ed with behaviors different from the 
AbleDefauIi Agent; For example, we: provide an 
AbieDefauliFIPAAgent that is an Able Agent that 
provides ail of the required FIPA agent behaviors, 
and the AutotiJ he Agent that enables hierarchical dis-i; 
tributed control; We discuss the Au tot uneAgent and 
additional A hie Agents in more detail later rn this 

Able A gents are situated in their environment 
through. the : use : of sensors and etfcetoh; ht abl^ 
sensors and effectors are Able UserDefinedFu net ion 
objects that map to method calls on external Java 
objects These methods usually call other applica- 
tion programming interfaces (APIs) to either obtain 
data (sensors) ot take actions (effectors) Able Agents 
are managers for sensors and effectors, and any cpn- 
lamed AbleBeans can invoke Ihusesensprs and ef- 
fectors. Sensors and effeciors titke arbitrary; a rgumen t. 
lists and return Java Objects to the culler.; j 



A common scenario is for an Able Agen t 1 o .contain: 
one or more beans that reference sensors and ef- 
fectors. For example, in Figure 4, the Abie Agent con- 
tains three AbleBeans, a single sensor, and asirigle 
e Hector. Able Beau A; first calls the sensor and ob- 
tains data from Application A, It processes the data 
and passes ihfornia^ B either 

through a direct method call, an event, or a prop- 
erty connection; AbleBean B processes these data 
and passes the data on to AbleBean C, which in turn 
invokes the effect ot ? resulting in a method call ; on 
Application B. 



ABLE component library •: 

A (uTidameiitarpiec'e oft|e:ABlj&systetri: Ls the win-' 
ppnent lito|y:0 

cess and filtering beans, machine learning algorithms, 
machine reasoning and mference engines, and high- 
er-level data mining agents comprised of one or more 
core beans. In. addition, ablb contains a set of data 
type classes defining Boolean, Categorical, Discrete; 
Nunictic, and String -literals, variables, and fields. 
This common data model is used by the beans in the 
component library. The set of core AbleBeans pro- 
videdwitb the able framework includes data beans, 
learning beans, and rule beans. 
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Figure A Example ABLE ag^nt 
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Data beans. Data access and transformation beans x 
arc used to manipulate data for training and testi ng 
the learning and reasoning beans. They include; . 

• Imp.ori-T-fca<\s space comma-, or tab-delimited 
•xxdata from Hat text files 

• DBImpott — reads data from relational databases 
usmg jrBB* ■* * (Java Beans Database Connectivity) 

.' • DataTabte- — provides a view over an Tmrx>rl data 
. set, with selected rews and columns 

• Filter filters, transforms, and scales data using 
translate template speculations 

• TimeSeriesFiiter^ caches sequenti al data for use 
in time-series prediction 

« -Export—writes space-, comma-, or tab-delimited 

data to flat text files 
r,i>»£rpo/7^wriles:dala>l:o relational databases us^ 

ing jpBC: 

Learning beans. Hie learning beans implement sev- 
eral dUlere.nl learning algorithms that can be com- 
bined witli the data beuiis prbyicle Jigbiweightdiitii i ,-. 
mining capabilities. They are: ; 

• Back Propagation implements an enhanced back 

propagation algorithm with pattern and hatch up- 
dates, hidden layer and output layer recurrence 

updates, and a Gaussian: neighborhood function 

• Tenipoml Diffetrmce Learning— supports sequence 
learning using a reinforcement. learning algorithm 

• Radial Basis Function— supports regression and 
classification using multiple basis functions with . 
automatic Sell- Organizing Map clustering .oJ hid- 
den layer weights 



* Naive Saves Classifier— supports incremental 
learning of discrctized data usrng a. Baycs statis- 
tics approach : . 

of diseretized data using the C4.5 algorithm . 

:■ Rule teans. The ABLERu 1c Language (arl) defines 
a rich set of rule-based knowledge represent. mo n for- 

; .m.ats including scnptixig using simple assignments, 
if-then and if -tiien-else rules, when-do pattern match 
rules, and predicate style rules, arl supports rule 

.blocks that are named groups of nues similar to .mac- 
ros. ABIE provides a wide range of inference engines 
to process the ARL rulesets. 

As illustrated in Figure 5, ABLE Rule Language can 
be represented in text or Extensible Markup Lan- 
guage 

the text or xml source into a set of AbieRuleBioclc 
and Able Rule objects and instanti ates an associated 
inference engine based on the inference method 
specified in the foileSet The ARL sunpoi Is very tight 
integration with Java classes and objects allowing in- 
stantiation, access to data members on objects, and; 
invocation of methods on objects from rules. Pro- 
cessors include: ' 



processes if-then rules . 

if-then 



'Boolean fornurcl chaining- 
umng forw ard cnaimng 

• Boolean bachmrd chaining — processes 
■ rules using backward chaining 

• Fuzzy forward chaining— processes if -then rules 
eonUim ng lmgius tic variables and hedges and sev- 
eral types of fwzy sets, and supports mullistep 
chaining -^V; 
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Figure 6 AbteRuleS^t bean aiid^s(oreno« '^riymes;-. 1 




• PinizniMiu di engine —processes when~do pattern : 
ma Ich rules using forward eh aining against a work- 
ing memory 

■ * Partem March /u:nvt?r/t ^processes when-do pattern : 
•i;': match rules using ihe Re te network forward chain- 
ing algorithm against a working memory 

• Predicate engine -- processes predicate, rules using 
a [)ackchanuTig algorithm with back I racking (sim- 
ilar to Prolog) 

• Stripiing.vn&ne^ il-then; 
if- then -else, while-do, and do-whiie rules in se- 
quential order 

Having a single ABLE Rule Language with pluggable 
inference engines provides many advantages, A sin- 
gle rule authoring and debugging environment can 
be used for multiple styles of inferencing. The same 
knowledge representation can be useiifi)r scrijiting:; 
agent behavior, dy na mica lly co ns i me li n g- a n d eo u - ; 
figu ring agents, and -explicitly .-representing domain 
knowledge;. Alternate implementations of the infer- 
ence engines can be developed for use in special- 
ized environments where memory or proccssingre^ 
sources are constrained. 



language design is the ability lo seamlessly mix sym- 
bolic rule : based reason jjig.witti s>il>sy tiiiohc iieuraj 
network and other inacliirie le 



common view is that the s u bco nseio us processes of 
the human brain correlate to neural network ap- 
p roaches and lb a t c onscious thcVug 1 it is si mi 1 a r t o 
symbol processing. ; A single ADLC rule set can rea- 
son symbolically about the outputs of multiple neu- 
ral components. Fot example, sensory data can be 
fed into a neural ne work for clustering into similar 
groups, for classification into categories, or for pre- 
diction of trends Rules can then process the out- 
puis ol the neural network, assign semantic labels 
lo those outputs, and reason about the outputs. Rules 
could decide to kick off a learning episode in one or . 
ta ore neural networks or to take overt actions to 
change the external environment. 

The ability of rules lo invoke other AbleRuleSet 
beans allows hierarchical con figuration and natural 
partitioning 

This ability eases the burden on rule authoring and 
maintenance, The example AbleRuleSet in Figure 
■ 6 shows the Java-like syntax and structure of the able 
: Rule Language. .Arbitrary Java clashes can be im- 
ported into a ruleset, domain -specific (uncticm librar- 
ies can be loaded, and a variety of built-in and im- 
ported variable types can be defined and mstanttated 
in the variables section Data are passed into and 



nients- pule tiiethods or ruleblbcks can be used to 
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Figure 6;; [A sample AblsRulySa^ 



















import corn ibrrunvCtess; 
library t. uj njbr >.m>LX^y , 


// use myClass as ubia fyps in rufest \ 

/! each pvbfio method b«f;cjrf}»s a tu K>tfpn 



variable* ( 

rnyCbn > > trtyl yp^Var new my{ tor>r>0; // creates an instaa ;g 
frjyClaos myTypcVar2 » nc-w m >C ;aos< ' nam*' , ag*'' "wftatevo 
Obj6Cl a«anVar Db)^): 

Chisel ftes^lt^ n-w Object); : • ": : 

inputs ( my'i /paV3t i ; 

oifif {Result } '. ;| ;li|lp^|||-;ll;i^;: ll.y llijl 

•vf;icj Inrh? { 

vetd tram() v^kg Script { 
At ONa^/ar -'4 r/f^MHsl-iHcK com ibpi.ab^^arw r«ifc» AhJe6ocaeanRo^S«t^! 

A* ft<?sttf ,v toc&ante^n^Ofr^/ar \* <\^V^Rut*$$t arP >, 

.Ao. FT^u^ - mrt( parent 1 aBeranNam^) 
AS RAaut - p* JCdSaB^tt' r& VrV<*il. 

■ ' i i'Wm 

v :' ;:' ; : • I' -V-- - 

I 



define one-time initialization: rules (the initC ) block). 
The maint ) block allows the user to specify the in- 
ference engine: tb at m If process the rules; Ine order 
.ofcv^ 

engine thai is selected. When the mainf ) block com- 
pletes, the optional idle( > block is run. 

Function-specific AbleAgents. In addition to the 
core AbleBcans, the ABLE component library pro- 
vide* a set of function-spec ific Abie Agenls. Data and 
lea rainy AbleBeans are combined to create neural 
classilication, neural cinstering, and neural predic- 
lion agents tha t can be used for lightweight data min- 
ing tasks. The set of standard 
provided with the AtiiS framework mcludesw 

• Genetic search agent— manipulates 'a population of 
genetic objects lihal. may include AbleBeans, 



• Neural classifier agent.-^ uses back propagation to 
classify data . 

» Nenralclustehng agent— uses self-organ izmg.maps : 
to cluster or segment data 

• '-Neural predictions 

build regression models ' 

• Script agent— ises the ABLF rule language lo de- 
fine complete agent behavior 

» JavaScript* * agent uses JavaScript to define agent 
behavior- • 

The NeuralPrediction Agent uses two Import beans 
to read training and lest data from tcxt filcs. two Fil- 
lers to preprocess and postprocess the data, and a 
back propagation neural 'network to perform the re- 
gression functioh (sho^wn later tn Figure 8). lie agent, 
provides higlirieve 1 (utieiicmalt fy through its Custom • 
izer as.it. orehesinites the opera tion of the five Abie- 



358 BKsUS tr AL 



IBM .SYSTEMS' JOURNAL VOL 41, NO 3, 2v02 



Beans it; cp ntains;. i isei: it.iri ly nec cis io spec i Ly the ; 
source data hits and correspond i )gu eta-data hies 
When initialized, the NeuralPiediGtionAgetu scans 
the source data ard autonaticattv generates thescal- 



Figure r Abf sBean wrapper design pattern 



ters 

through ilic ncurnj network. Based on the number 
of input and output fields and their data represen- 
tation, the neural network architecture is automat- 
ically configured. Data- llow connections between; the 
AbieBeans pass data from the iriiporl through the 
input Filter, 'through the neural network, and then 
through; the output Filter; The user a [so specifies tar- 
get ;error rates and the niaximuift number of train- 
ing epochs. The asynchronous thread of the Able- 
Agent is used to automatically train the prediction 
model on a separate background thread and halts 
when the user-denned termination conditions are 
; . met 

Once trained, the NeuralPrtxIiclionAgent can be 
used to process data synchronottsly. jj the model be- 
comes stale after it: is deployed- theapplieatibn could 
easily force a retraining of the prediction agent, be- 
cause the training [Process is automated. 

The NeuraiCiassifierAgenl and NeuralCiustc ring - 
Agent are constructed using multiple AbieBeans in 
a manner similar to the prediction agent but pro- 
vide classification and clustering functions, respec- 
tively. The neural learning agents provide basiedata 
mining functionality for use in other Abie Beans, giv- ; 
ing agents the ability to segment,; classilyyand make ; 
predictions about their environments. 13 . 

Extending ABLE using custom beans 

In addition to the core AbieBeans provided in the 
ABLE component library, users can easily wrap new 
or existmg algont hms to create their own: beans. Sets 
of dom a in -spe ei lie bea ns c:a n be a dded to the a HIP.: ; 
Agent Editor and dynamically loaded from a JAR 
f Java: A Rc hive) lile A simple : design pattern requires 
that the algorithm object be wrapped by an Able- 
Bean instance, a Bean Info file be created to specify 
a ny membe rs to be externalized, and a GUlCu steril- 
izer class be provided to allow users to set any ab 
gorithrii unique attributes. 

This approach was used to incorporate the Decision- 
Tree and NaiveBayes ela&sifier.leanmig components ■ 
into ABLF As shown in Figure 7, the three Java 
classes required for able integration are the Able 
Bean class itself, the Bermlnfo ihatdelmes beativ; 




properties and accessor methods, and the bean Cus- 
tomi/er that provides the GUi used to set configura- 
tion properties on the beau. The AbleBean must eon 
tain an instance of the algorithm class, map Lie mri( ) 
and [Process? ) methods to call functionally equiva- 
lent methods on the algorithm object, and also wrap 



i'zer. This approach allows the algorithm code to re- 
main unmodified while allowing it to be used as part 
of any AiiLhi solution.' : : 

ABLE development tools 

The ARV,F Agent 1 IdilOr is a Swmg-based interactive 
development and test environment. It provides a tree; ; 
view of the agent with drill down into contained beans 
as well as aeanvas view of the agen l with correspond- 
ing data, event, and property connections. Agents 
can be loaded, edited; and saved to external files us- 
ing Java serialization. ABLE Inspectors provide text 
and graphic views of object.dat a using Java intro- 
spection. Support is provided for adding custom in-, 
spec t or views in addi f.ion to standard line, bar, x-y 
plot, and pie charts. 

The Agent Editor can graphically construct Able- 
Agents by using the library of core AbieBeans and 
; AI)ie^geht5 as building blocks. Data-flow, event and; 
proprty connections can be added using the GUI 
environment Agents can also be hand-coded and 
then tested in the ABLE Agent Editor Each Able- 
Bean provides a Qjstbmizer dialog that is used to 
cbnligure it and to set property values. Figure 8 shows 
the ABLE Agent Edit()ir with a single NetiralPredie- 
lioiiAjgent heart iloadeduitc* a default agent '['he user 
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Figure 8 ThVABUE Agent i Editor::; 







: >i& 


Ski. 










^^^^ 



:has drilled clbwri iiitc> the Meura [Prediction Agei it ari( 1 
is viewing the live Able [leans it con tains °) hese beans 
are displayed in the right-side canvas. 

When itieAgen t Editor is si axled, illoads Ablc^iuV&i; 
from jar fti^ 

ifying the page on the toolbar palette where the bean 
should be placed Thus, users can easily provide their 
own custoiri AbleBeahs andAbleA 
the Agent F-.ditor in combination with the core Able- 
Beans. 

■'ABLE Inspector windows use introspection to displays 
bean data members and state information. Inspec- 
tors provide text views as well as graphical: views of 
the bean data. Views such as bar charts, line plots, 
andxy plots are provided Users can select one or 
more bean properties to be displayed, or one or more 
indexed properties such as arrays or vectors of ob- 
jects. In addition, Inspectors allow users to select 
multiple data items lor use iii; tmie-series displays;:; 
The Inspector caches the data points at each time 
step and displays the desired This 



function is very useful I or observing time-series pre- 
dictions and agent controller behavior over tmie. : 

Figu re 9 si i ows two I ns pec to i s J: ro i u t h e Mar ket An - 
alysis example provided with the able toolkit. The 
Inspector on the left shows the clusters of a SelfOrr 
ganizingMap neural network with labels and cate- 
gories assigned to each cluster. The Inspector on the 
nght shows a bar chart of the weights of the winning 
duster. 



ABLE agent platform 

The able agent platform provides a set of services 
for Able Age nts th at form multi agent sy'Stems.. 'ilfe 
. services include stand 

(e.g., create, suspend, resume, quit ) as well as direc- 
tory facilitator and agent communication functions. 
Xhe. ABLE platform is a distributed agent platform 
supporting- agents; on multiple physical systems t hat 
communicate using Java Remote Method Invoca- 
tion (R\flj The able agents can communicate with 
■ one;"tfnother ear- 
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Figur* 9 Bwtmpte ABLE lr spec tore 
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lier (AbJeEvents or direct method calls) or with other 

PiPA-oomphanl agents and agent^^^ 

the use of the fipa agent communication language. 

As shown in Figure 10, the able distribii ted agent 
platform, corresponds to the FIPA abstract architec- 
ture. The current am;f platform conforms to the 
HPA 97 specifications. Work ism progress to adapt 
it to the more recent FIFA abstract architecture and 
conform to the Java Agent Services Oas) being de- 
veloped under the Sun Microsystems Java Com mil- 
niiy Process JSR 87 The jas provides a set of Java 
interfaces and a reference implementation of the 
platform services required for a distributed agent" 
platform that complies with the FIPA abstract archi- 
tecture. The art F. pla tforrn includes ■additional func- 
tiona lity covering agent life-cycle managernent ; ser- i: 
vice regjstratjony and agent security The following 
services areprovided as pari of the standard services > 
supplied by the "able agent platform: :: 

• BooterandJen-we-Rdoty^ivvldcsXhc startup and 
root services to agents that want to communicate 
with the agent platform "services, and agents run- : 
rung on the platform 

• N(mun^Scmces^pr6yk\es a unique name for each •• 
; agent registered with the: platform . 

• Transport Services:— provides a ■ .■m^an'S^i^ir-/ 
agents to communicate via multiple f.underJymg: 



communication transports including Java iimi and 
HyperText Transfer Protocol (im?) 
■ ''?;p!wcioty/& a means tor agents to 

register descriptions of. themselves to allow other 
; agents to find them and to find other agents 
♦ Life-cycle 5fivic«s^-provides a Factory: service 
that allows new types of agents to be added to 
: : : .ihe platform ; aud; for an administrator to 
creaie/start/suspend/resume/stop agents running 
on the platform. Support is also provided to move 
agen Ls from one sys tern l o ano iher on the pla tform 

The agent Console provides a centralized graphical 
user interface for administrators to access The direc- 
tory services and life-cycle services on the platform 
: Agentscan 

ing t he Console Additional systems can be added 
or removed f-c ih the agent platform using the Con- 
sole, Direc lory services can be queried to find the 
. status on agents or of collect] oiis ofagents 

. based ; :6h : service attributes. • ; ; : ' •- : ; : . 

ABLE application design^ 

The. ABLE toolkit is quite flexible and can be used 
to add'mtelligence to. applications in a variety of ways. 
One or more core : AbleBean components 'could be 
used in ah application :ip provide specific functions. 
Additional domain -specific Abie Beans stich as nc^vel 
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Figure .1 0 The ABLE distributed agent platform 
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Figure 1 1 ABLE application design example 
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optimization or data processing, techniques can be : 
developed and mixed with the core AlSfeBfeiUislAii--^ 
lonotnousJgenU conip^d of imlliple AbleBearis 
could be .used to provide function to. the application 
As ill jstrated in Figure 11, AbleAgents can bridge 



•IhcgnphchvcentlicABIBcom 
application world by extending the AbteDelault- 
; Agent a nd ntiplemenu'ng the aj^licattbn-specific in- 
terfat c s, or by extend mg a base appl cation class and 
jmplemen ling the AbleBean interlaces This ap- 
proach allows .ail of the power of -the AbleBean com- 
ponent library' to be used 10 add new function to the 
application environment and is highly recommended. 

In the following subsections, we present two appli- 
cation case sin dies that illustrate how ABLE compo- 
nents can be used to quickly develop solutions 'Hie 
case studies are used as concrete examples of the 
various ways m which the abi,b framework, compo- 
nent library, development tools, and agent platform 
combine to enable development of multiagent au- 
' lohomic applications;; I : 

Case Study 1 : System administration using ABLE. 
A Ivnsic system admiiiistratioi) multiagent system was 
.developed for the: JB\f eServer iSeries * system using 
ABIJR (see Eigure !?)> The goal was to provide an 
overall view of system health using tnultiple agents 
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Figure 12 System administration using ABLE 




-; lo monitor CPU utili2ation, ihe workload as indicated 
by the number of jobs running on the. server, cur- 
rent disk utilization, and the expected disk utiliza- 

: lion. The monitor agents are autonomous and use 
the built-in ABIE limcT event processing t o monitor 

■ . the associated .system resources at selectcd:timci.n-. 
lervals. When any one or the monitor agen ts detects 
a significant situation, it sends an even t that is pro- 
cessed by the SysAdmin agent. When the SysAdmin 

: : agent receives the event, it is processed by an inter- ' 
nal AbleRuleSet agent fcailedSysAdminBrain) that: 
invokes other agents to gather additional informal: 
. lion. 

The SysAdmin B ram Able 

the task agents to perforai operations such as find- 
ing du plica le jobs, find ing runaway jobs, finding large 
objects or files, and cleanup. Ihei mdlargeObjects 
task -agent .uses the ABLE DBImport bean to perform 
a. query to find the largest objects or riles on the sys- 
tem. The Task agents are simply information gath- 
erers. They do not take direct actions. The. actions ; 
are performed by the Sys Ad minAclions agent that 
contains another AbleRuleSet agent that either 
prompts the user io approve an action or automata 
ieally takes a remedial action such as killing a run 
away job or deleting a system object .' 



A rudimentary SystemAdmin client GUI, shown in " : 
Figure J/2, was developed using Java Swing. It com- 
municales wilJh the SysAdmin agent using the RMt 
connectivity that is built into the ABLE agent ■■frame----' 
: --worlv. /rhc SysAdmiji agent alki sends a report of 
: : any actions it. has taken to the client. lor display to 
the user. The client can also send these- findings to . 
a list of e-mail addresses so users can keep track of 
system management agent actions. . . • 

-■!: .■!■■ The SysAdmin agents were developed overa.period 
of two weeks. The developers were new to the Java 
; : language and to the ADLE fooJkiti.They made use of 
the" A RTF Agent Rditor and AbleRuleSet editors to 
; • develop and 1 est the agents : and associated nilesets 
V defining their l^iiavior. Tltey used the; distributed 
RMl capability to bmjd an application that, runs on 
a single client system and can monitor multiple server 
systems, litis case study demonstrates the produc- 
tivity gains made possible through use of a standard- 
ized agent toolkit as well as the ingenuity of the de- . . 
velopers. 

Case Study 2: A diagnostic application. Another 
use of ABIB technology m IBM products is in the area 
of server diagnostics The iSeries, electronic support 
team is. constructing a set of ABLE agents to perform 
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: . dala collection; problem determination, and prob- 
lem source identiiualion tasks, lhe scenario is that 
a customer call comes into the support center* The 
customer support representative asks a semes of 
questions describing the: situation, syinpiomsii arid 
other relevant informalion* One or more ADLB 

. agents arc . then dispatched to the customer: iSeries 
machine to help diagnose the piohlem 

Several steps, are required lo automate the diagno- 
sis o; machine problems. These steps m elude data 
collection, data formatting and preprocessing, data : . 
analysis and problem detctinihatioh, ani finally; ad-' ; 

. . vice o r au to ma ti on of the p rohlejh resol u ti o 3 The ;:' 

. AWT; toolkit provides beans and tooling to aid m all 
of these tasks. The ABLE Rule Language enables: 
agents.to call external programs to. collect data. The 
Able I mpor t s a How a n agent t oc o Uect dala and pass 
the daUi lo another: for analysis, using an external" 

. database or text file as the storage medium. An Abie- . 

: DataTable bean provides a view over ..the external 
data m column major order. 'Hits view allows indi- 
vidual metrics to be analyzed as a time series and 
for groups of metrics to be correlated and analyzed 
in a time-series fashion. 

Ano ther cxli mple ; of :a- diagnos tic application is an 

: autoihotK'e diagnostic pro totype developed in part- 
nership wilh IBM Global Services. In this application, 
lhe ABLE Rule Language was used to perform time- 
series analysis over a 40-second time series, looking 
at multiple engine sensors to identify misfire com 

■ /dltions; In the production application, wc foTesee de- 
velopment.; of, a . comprehensive . set of diagnostic- : 

: agents, each capable of detecting the presence o r ab- 
sence of a particular fault or closely related set of 

. faults; 1 * - ; 



peeled problem was found after the release of a new 
system, diagnos he agents could l?e made available 
io assist customers and suppdit represeiuauves at: 
auy t ime. Flexibility is one of the major advantages : 
of an agent-based solution, v " : - t' 

Autotune agent 

One of the basic operations ! equired by autonomic 
systems is closed-loop control, where the state of a 
t a rger system is monitored;:. cdiinpared to' some de- 
sired goal si ate, and l hen adjusted as required to 
move toward the goal slate w As compu ter opera* - . 
mg .system's, middleware, and applications have be- 
come more complex; literally hundreds or thousands 

: of pa ra mel e rsnm st be con (jgu re d in order to .keep . 
everything rurmirtg smoothly. A practical autonomic 
system would be composed of many controller 

:: agents, distribu ted across many computer systems,!. • 
and operating at various levels in a ■ hierarchy !:indi.-|:" 
vidual controller agents would receive high-level 
goals from above and, in turn/control resources and 
applications at lower levels in the hierarchy. 

A generic AutotnneA.gent.has been developed that, 
addresses many of tJiese requirement, This agent 
■ extends the Able Do fault Agent class but completely 
overrides the agent behavior. The Autohme agent 
.contains one or more AutotuneGonlroller beans that 
provide control strategies and one or more Auto- 
tuneAda systems 



orai 



riving the higher-order diagnosis (for example, three 
faults identified by individual agents are related and 
point to a single point o f failure) and providing a. 
diagnosl k iree to find the root cause of the failure 

I here are several advantages to the multiageiu ap- 
proach. Diagnostic agents can be developed mere- ;!; 
mentally to. resolve the nxofii ceinmon : (or most dift : 
ftcult) problems first a nd, overt ime, can (>e combined ;;: 
to covermore and more of the problem space, The : 
.ABLE Rule Language can be used to define the di- 
agnostic, reasoning and data analysis tasks, provid- 
ing additional can be developed 
i)y ,the. support :t.eath and deployed at any point in 
the release cycle, as opposed to being tieel inip llie 
system release schedules. For example, il an unex- 



ions. 



A set of AutotuneMetfic classes is defined to rep- 
resenl the slate of the targe t system. Configuration^ 
Workloads and Service-level mdicators are read-only 
metrics that provide state information to the An to - 
timeAgent. TuningControl metric can be dynam- 
ically set by the agent, Hie AutotuneAdaptor defines 
the set of metrics supported by a target system, llisse 
;. metrics are maiiage3d ii^ a col lection by the agent and 
• ca ri be ; logged to a li ist or ica ( data repository. 1 

Figure D shows the architecture of an Autotune 
Agent. .Hach Controller bean provides its own Cus- 
tomizer out to allow the user to configure its param- 
eters Each Adaptor bean provider a data panel that 
allows the user to see and set target system metric 
.values. The Auto tune Agent Cuslomizers allow ihe 
user to select which Controller bean Ls the master 
(if there is more than one) and to set polling rate 
: and other pararnelersV ' . ; 

The AutotuTieAgent supports both distributed and 
luerarchical control r distribute (3 l^y virtue of the agent. 
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.being an Abie Bean> hierarchical when the target sys- 
tem is another Autotune agent. Autotune ag^ 
have been applied to tuning 1 ,olus Notes* servers, 
Apache Web servers, and DB2* (database 2*) util- 
ities. 

Case Study 3: An Autotuno agent for 
Apache Web servers 

In this application, a muitia gent feed back control sys- 
tem based on ART, E Autoiune. agents was developed 
for a i ) torn a tiea 1 Jy 1 1 1 ning the Apache Web se rver pa- 
rameters, 'lyrically, the Apache tuning work is done 
by the system adn tmistrator. The objective is Lo main- 
tain the system CPU and memory utilization at a de- 
sired level so as to avoid overload or to reserve cer- 
tain -resources for other applications. -This objective- 
requires significant effort because, the relationships 
between the desired CPU and memory utilization lev- 
els arid the • available tuning parameters (namely, 
Max Clients and Keep Alive timeout) are not clear. 15 
Moreover, this tuning work must be .done frequently 
since these relationships are affected by the work- 
load, and the workload can vary over time. 



To automate the Apache server tuning process; three 
Auiotune agents wctc designed and built for lite 
three phases in automatic feedback controller de- 
sign and deployment (as shown in Figure 14). In or- 
der to understand the dynamic behavior of the server, 
a modeling agent is first applied to generate lime- 
varying signals for the tuning parameters MaxCii- 
ents and KeepAiive. Sine waves are used with mag- 
nitudes and frequencies specified: through: the 
Oistomizer GUI. The server behaviors (CPU and 
memory utilizations) under these exciting signals are 
recorded and passed to the controller design agent 
through iext hies and ABLE Imports. The controller 
design, age n t ; uses; system ■ i den ti ilea lion : techn iques 
to extract a first order linear model from the col- 
lected data. Based on this model, a linear quadratic 
regulation (t oil) controller is designed in order to 
ineet certm'n design criteria specified by the .user 
through the Customizer GUI, such as minimizing the 
difference between the desired and measured uti- 
feations and minimizing the changes in the tuning 
parameters. The output of the controller design 
agent is a set of controller .parameters that are passed 
to the run-time control agent. Tne desired utiliz.a- 
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Figure 1 4 Structure hi the mtilliagWn system for the Apache Web server 




he n level is a lso specified as the control goal from 
Ibe systenr ^adrnin.istraipr: J:iif(>u'gh: : the -cSistoTTi i/.er 
GUI. On the h:\sis of this information, {lie feedback 
controller interacts wiih the Apache Web server to 
dynamically adjust the MaxClients and KeepAbW 
tuningparameters to meet the desired cpu and mem- 
ory utilization levels. 

Figure 15 shows an example control run. The con- 
trol interval -S; five seconds. Around the tweniieth 
com rol in ten/a 1 The workload increases as a group 
of heavy users stari to access dynamic Web pages 
(in contrail to normal users visiting static Web pag- 
es) This workload consumes m or e astern resources, 
causes large increases in CPU -utilization; and slightly 
increases memory utilisation. In order to maintain 
the desired utilization levels (e.g., U.5 for CPU and 
0.6 for memory), the to 

and Keep Alive are automatically adjusted by the 
feedback controller. In particular, a larger KeepAltve 
vaJueisitsedU 

Clients value is adjusted temporarily according to 
the dynamics of the server. 



Subsumption agent 

One of the basic-tenets of a ri if'icial intelligence over 
the yea rs b as bee n \ he symbol system hypothesis, pos- 
ited by Simon in 1969,' His assertion is thai people 
are intelligent because we 'process- symbols and that 
only symbol-processing capabihties'a.re re(]uired to 
produce intelligent machines. But this hypothesis 
begs the question of how those symbols' become 
grounded to sensory mpuLsa-id perceptions from the 
real world. 

In response to this problem, Rodney Brooks, who 
was working on robots at the Massachusetts Insti- 
lute of .Technology, proposed an architecture that 
relies on representations that are grounded in the 
physical world. Brooks: says, "The key observation 
islhat the world isils o^ 
lion archi^ 

chanical robots. This architect!! re uses the notion of 
layers of behaviors, each built upon the lower- level 
competencies and each responding directly to sen- 
se) ry;ii! puts via eJlectors on the world: 
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Figure 1f> ' Performance of the Autotune controller lor the Apache Web server cnder dynamic 'workloads^ 
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The AbleSubsumptioiiAgeiit extends the Able De» 
fault Agent class and introduces the properties and; 
behavior necessary to define new capabilities in such 
a system. There are three types of AbleSubsump- 
tionAgent: reflexive, reactive, and adaptive. Reflex- 
ive agerits are simple arid: fast. They respond quicldy 
to changes i n Sensory: inpu t and usually /use simple; 
. rules to define .their behavior Reactive agents are 
more complex They take inore tiine to evaluate and 
respond to cha uges in- inputs, and often use data- 
driven forward inferenciiig or ; goal -diTected back- 
ward infercnxuig. Adaptive agents learn from expe- 
rience and -modify their behavior based on past 
actions and subsequent feedback AJ1 of : these Sub- 
sumption agents contain the notion ot levels or Iked 
priority as defined in the subsumpf ton architecture. 
Although subsumption had a strict hierarchy, mul- 
tiple AbleSufisuihjitionAgeiiLs can reside at [fie same: 
priority level arid represent alternative cooperative;, 
or competitive approaches. in responding to inputs. 



•Autonomic agent 

In this section* we outline an architecture and meih- 
odology for building an au tonorhic agent capable of:- 
playing a role in a futuit autonomic comp^ 
frasi^ 

AbleDef au It Agent and contains niu itipie aLitono- 
rnbus or seiniautonoinous AbleAgents from the 
: AJ^fc ccmxrx):nent hl>raiy. The internal agents coop- 
era te arid comj)ete to take co n tro j of the intelligent 
system and: make the appropriate response, much 
like The base agent 

architecture is shown in Figure 16. llie architecture 
contains a central pool of subsumption agents sim- 
ilar to that of Brooks ^ with sensors, and effectors 
proYiditg inputs from and outputs to the external 
world. Three defined behavior layers implement the 
basic reflexive beiiaviorSj the c()iri[^exiustinctrve re- 
active behaviors; and the more complex .behaviors 
learned from interactions with the world. These three 
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Figure 16 An autonomic agent architecture 




levels arc implcmen ted by . A b.lc Agents that arc con- 
tainers lor multiple AbleSubsumptioTi behavioral 
agenlsthat implement domain- or situation-specific 
behaviors. 

Our; intelligent autonomic agent: must build and 
maintain a model of the external environment and 
of its own components A top-level executive: ecm r . 
ponent makes decisions based on the models and its 
current emotional state. A- planner component is 
used to create multiple step scripts or sequences of 
actions necessary to achie ve the high-level goals be-: 
iug pursued by the executive; Like the behavior lev- 
els, the models, emotions, executive, and planner 
components are all implemented as Able Agents that 
in turn -may bexoFnppsed of othe r Abie Agen ts a nd 
AtyeBeans/The.l^ 

data and event Hows between the components in the 
autonomic system By constructing the base agent 
using ABLE self -similar components, intelligent au- 
tonomic systems of widely varying complexity eo^ld 
be built using this architeelure: The systein retains 
all of the ad^ 



siibsuinpt OTi architecture while addng internal men- 
tal stales, including models of the self and world; 
emotions- learned t>ehaviors, planning, and meta- 
level decision-making. 

Our thinking has been hu]ueneed : by prior work in 
this area, most notably Sloman and Minsky„ Rie- 
cken has; implemented the M system. that corre- 
sponds to. Minsk's architecture with multiple rea- 
: ft n s, ni le- 

■ based inferencing, and semantic networks for 
representi ig domain objects *' Butler et al.. 1 * have 
implemented an object-oriented version of Brooks' 
subsumptipn architecture 10 Sloman was one of the 
first to -discu^ and 
his three-layered model with reactive, deliberative,, 
and ''reflective : processing:! similar: 
to this architecture: * Qiulfield and Johnson sketch 
an architecture for a "conscious" systexn; whose com- 
ponents correspond to the Autonomic agent archi- 
tecture; 4 Jonker and Treur :o preseii L a mull iagen t 
arehuecture intended to simulate animal behavior. 
Pieard? 1 g^ves a gob(l overview of the computational 
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issues rented to. machine general inn mid recogni- 
tion of emotional states. 

The novelty in our approach is ihe use of an agent 
stx uctuie with, well-defined functional components, 
where those components themselves are mulaagent 
systems. The ABLE: framework and agent platform 
make constructing systems like this feasible; The ex- 
ist ihg ABLE coniiponen t library-' provides as with a ric:fr> 
sci of machine learmng^ii^ 
on -which to base ounmpk mentation. Although we 
have jiLst started down this road, our experience with 
building other higher-level agents, such as the Au- 
to tune agent, gives us confidence. Our (inn belief js 
that any : truly autonomic system will require one or 
more agents of this type as part of the architecture. 



Concluding remarks 

Our objective in this paper was twofold: to describe 
the set of functionality .provided in the able toolkit 
and todemoriiitra-eitsuu^ 

studies. Although we selected three examples, they 
are just a few cases where ablv. has been used. We 
have applied the a?jlb agents to multiple problems 
in systems management including event processing, 
.performance monitori ng u sing a d aptive thresholds, 
■ .isysteih health monitoring using hierarchies of fuzzy 
: rijies^ 

agreement management using neural networks; 

ABLJB components have been successfully applied to 
e-eommerce, including cojiputingcotnplex discounts 
in a business-to-lnisiness environment using IBM 
WebSphere* Commerce Suite. The ABLE rule en- 
gines have been used m conjunction with the 
BRBeans component in the WebSphere. Application s 
Sender Enterprise Extensions. The ABLE fra mewbrk i 
and component library will be shipped as part of ani ; 



cation agents for performing communication traces 
and data collection are slated ix>r production use by 
the j Series eSupporl organr/.atton. Additional sys- . 
terns management agents 'ire also in development , 

We continue icadd new algorithm beans to the ABLE 
component library The development of the Able- 
SubsumptionAgent and AbleAutonomicAgent will 
take place over the next year We plan to add the 
IRIS (information^ representation, hrferencing; shar- 
ing) hy{)erg'rap[i k nowledge rep rese nla ! ion lp use as: ; 
an integrated . method, for encodijig and reasoning", 
alxnit domain knowledge. 23 '' 



;:. We have described a series of agen'Ls thai could play, 
the role of intelligent nodes in an autonomic com- 
puting system. One could easily imagine networks 
of distributed intelligent 

: : operating systems, network resources, database and. 
hie systems, middleware, and . applications while 

: simultaneously being managed by other agems in the 
hierarchy. At various points in the network, we may 
require relatively simple agents, dominated by re- 

: llexive- behaviors;: At iiiglier levels we may require, 
complex reactive behaviors, learning, and adaptation. 
It is unhkely that we will reach a fuUy functional aiir 
tonomic computing system hi- p.ne giaht leap. . We will 
need to incrementally expand she depth and breadth 
of intelligent. behaviors available to the individual 
agents as wcll as to the entire distributed. autonomic 
system. 

: In the future, we plan: to leverage our work on. tiie 
ABlJE toolkit to further explore the world of auto- 
nomic computing. This grand challenge will lively 
attract a large number of researchers using a wide 
variety of technical approaches. We intend to attack 
the autonomic computing problem from an agent- 
based perspective. We plan Lu build on this work by 
adding higher levels of abstraction and sophistica- 
tion to our agents and our agent platform as we pur- 
sue: the goal of building.truly autonomic computing 
systems. 
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